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A sequence of outputs from a stationary memoryless source is 
encoded into n code streams sent over n parallel channels. Any k or 
fewer of these channels may have broken down, unbeknown to the 
encoder. The receiver maps the streams from the surviving channels 
into a reconstruction sequence for minimum distortion. This distor- 
tion will take different values depending on what subset of channels 
is operative. Let D max be the largest of these values, the worst- case 
distortion. This paper shows that the infimum of D max over all 
encodings is the same as if the encoder did have knowledge of the 
breakdown situation. 

I. INTRODUCTION 

Consider a stationary, memoryless source emitting at each unit of 
time a random variable X, with values in a measurable space 9C. An 
encoder maps this source stream into n code streams for transmission 
over n channels going to a common decoder. 

The channels have positive capacities 

d<C 2 < ••■ <C„, (1) 

the inequalities following by the choice of the indexing. Up to k of the 
channels may in fact have broken down, so that 



*-M") (2) 

situations are possible, but the encoder does not know which of these 
K situations is realized. The decoder uses the streams from the oper- 
ative channels to form a sequence of reconstructions X t in a measurable 
space 3C, (often, but not necessarily, the same as 90 . Performance is 
measured by the time average of a distortion function d(X t , X,). For 
any given coding scheme, the expected distortion will depend on the 
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breakdown situation. Here we focus on D max , the largest of the K 
distortions. D mA% is the expected distortion one can guarantee, subject 
to the assumption that no more than k of the n channels will break 
down. 

If the k channels with the k highest capacities have broken down, a 
total capacity 

P - £ Q (3) 

i-i 

is left. Then even if the encoder knew that this was the situation, the 
distortion could not be made lower than 8(p), where 8( • ) is the classical 
distortion-rate function for the given source and distortion measure. 1 
A fortiori, one has 

Z) ma x>6(p). (4) 

In this paper it is shown that this bound is always sharp, i.e., 
Theorem: For e > it is possible to achieve 

Anax < S( P ) + € (5) 

by using appropriate coding with large enough block length. 

Thus, in the problem of minimizing Z> max one can do as well as if the 
encoder did know which of the K breakdown situations was realized. 
The price paid for this is that, as will be seen, one has effectively to 
"throw away" most of the excess over p of the capacity available in 
nonworst situations. 

II. REGROUPING OF THE CHANNELS 

If the capacities C, i > n — k are all reduced to the value C n -k then, 
by (1) and (3), the value of p is unchanged, and if the result holds after 
such reduction it holds, a fortiori, before the reduction. This means 
that the extra capacity 

Cextra= £ (G ~ Cn-k) (6) 

i—n-k+l 

can be used for other purposes, such as to reduce the distortion in 
some situations below Dmax. Thus, we assume henceforth that C, = 
C-k for i> n — k. 

The channel coding theorem 1 implies that given e > any channel 
of capacity C is equivalent — for large enough block length and with 
appropriate channel coding — to a channel accepting binary bits at rate 
C — e and delivering them with arbitrarily small error probability. 
Thus, we can assume that all n channels are binary with rates C\ = C, 
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- Cl (j ■ 1, . . . , n), and that they transmit blocks of sufficient size 
unaltered, with probability. 1 - e 2 , with e u e 2 positive, arbitrarily small. 
Lemma: For all e > 0, it is possible to transmit sufficiently long 
blocks of binary bits at rate p - e with error probability less than e, 
as long as no more than k channels are out of order. 
For the proof, let y\ = d and for i = 2, •••,» — k s 

yi = d - C'i-i. (7) 

Then one has 

d = i yj (8) 

for i = 1, ■ ■ ■ , n - k, and 

for i > n — k. 

By (1), the n — k numbers y, are nonnegative. As a channel of rate 

iv 

is equivalent to i parallel channels of respective rates yi, 72, • • • , yy, we 
may consider the following regrouping of these channels: 

Group 1 consists of n channels of equal rate yi. The ith of these 
channels is part of the original channel i. 

Group 2 consists of n -1 channels of equal rate y 2 . They correspond 
to parts of original channels 2 through n. 
Continuing in this fashion: 

Group i consists of n — i + 1 channels of equal rate y,. They 
correspond to parts of original channels i through n. 
Finally, group n — k consists of k 4- 1 channels of equal rate y n -k, 
corresponding to original channels n — k through n. 

Note that for i = 2, • • • , n - k, group i is missing i - 1 channels 
corresponding to the first i — 1 original channels. These missing 
channels can be viewed as permanently broken down channels of an 
imaginary group of n. As up to k of the original channels may break 
down, group i, when considered as originally made up of n channels 
(of rate y,), may have up to k + i - 1 broken down channels. This is 
so for all n - k groups, i = 1, • • • , n - k. Now we invoke the known 
fact 3 that n channels of equal rate y,-, out of which at most k + i — 1 
are out of order, can be used to transmit binary bits error-free at rate 
(n - k - i + l)y, using truncated Reed-Solomon (trs) codes. 2 

Thus the n - k groups yield a total error-free rate 
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n—k n—k i 

ZCn-A-i + Dw-ISv 

i=l «'=1 y'-l 

n-k 

= S Ci 

= p - (n- k)€\. 

To split a binary block among the n — k groups and assign to each 
group an integral number of bits — a multiple of its trs bloc coding 
length — rounding may be required with asymptotically negligible 
losses of rate. In addition, the assumed noiseless behavior of the n 
channels only holds with probability (1 — €2)". As all the e's involved 
go to zero as block length increases, the lemma is proved. 

Thus, there exist coding schemes, valid in all K situations, which 
convey data from transmitter to receiver as if a channel of capacity p 
were between them. Then (5) follows from the classical rate-distortion 
theory. 

III. SPECIAL CASES 

For a binary symmetric source with Hamming distortion, that is, 

d(X, X) = when X = X, 1 otherwise, 

one has 

8(p)=h- l (l-p), 

where A _1 (*) = for x < 0, while for < x < 1 it is the inverse of the 
restriction to (0, V2) of 

h(x) = -x log 2 x - (1 - x) log 2 (1 - x)} 

For n channels of equal capacity C, of which k can break down, one 
has p = (n — k)C so that the limit of achievability is given by 

D mail = h- x a-(n-k)C). (10) 

If in particular C = n~ l (channels of total capacity 1), then 

Dmz^h-Hk/n). (11) 

For k ■» 1, if one insists that the distortion approach zero when all n 
channels are up, one can achieve 4 distortion (2 1/n — l)/2 when any 
channel is down, which is of order n~ l . If, however, one only cares 
about maximum distortion, then one can approach h~ l (\/n) which is 
of order (n log re) -1 . 

If, for example, n * 3 and k ■» 1, then (2 1/3 - l)/2 » 0.130 while 
»~ 1 (%)«0X)62. 
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